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Abstract 

Establishing and maintaining effective Command & Control (C2) is essential to mission 
success. Over time, C2 has evolved due to changes in technology, doctrine, and threats. While 
C2 may be necessary, it is not sufficient to guarantee mission success, which depends on 
many factors. This research investigates a time-valued information entropy-based method 
used to quantify battlespace awareness. The goal of this research is to determine how this 
existing information entropy-based method can be extended to aid C2 decision makers in 
understanding and evaluating military C2 effectiveness independent of mission success, 
particularly for complex military System-of-Systems network architectures. The end result is a 
set of analyses that can be incorporated into traditional Modeling & Simulation techniques to 
evaluate and classify C2 system performance under varying factors and conditions. These 
changes can include differences in the following: C2 systems and approaches, enemy action, 
information sharing and decision making, planning, intelligence collection and data gathering, 
platform and sensor performance, etc. From this, a more quantitative estimate of desired C2 
attributes such as agility, robustness, and responsiveness can be achieved. Collectively, this 
set of analyses is referred to as TABS or Tracking Awareness in the Battlespace during 
Simulation. 

Introduction 

According to the Department of Defense (DoD), C2 can be defined as "The exercise of authority 
and direction by a properly designated commander over assigned and attached forces in the 
accomplishment of the mission. Command and control functions are performed through an 
arrangement of personnel, equipment, communications, facilities, and procedures employed by 
a commander in planning, directing, coordinating, and controlling forces and operations in the 
accomplishment of the mission" [1]. Ref. [2] provides a more detailed breakdown of the 
essential C2 functions that must be executed: 

Establishing Intent 

Determining roles, responsibilities, and relationships 
Establishing rules and constraints 
Monitoring and assessing the situation in progress 
Inspiring, motivating, and engendering trust 
- Training and education 

Provisioning (Resource Allocation) 

Each of these functions can be further decomposed, if necessary into even more activities, 
functions, or tasks specific to any organization. The salient point that must be recognized, 
however, is that establishing and maintaining effective Command & Control (C2) by warfighters 
is essential to mission success. 
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While the purpose of C2 remains unchanged over time, C2 itself has evolved due to changes in 
many factors. These include advances in technology, changes in doctrine, and changes in the 
threat environment [2]. For example, today's military depends on progressively complex 
information technology to conduct joint operations against increasingly asymmetric forces. The 
end result is a dynamic operating environment with changing force capabilities. These types of 
challenges affect how well C2 is being performed over any length of time. 

The importance of C2 in achieving military objectives along with the dynamic operating 
environment underscores the pressing need to evaluate how well C2 is being performed. Yet 
the official DoD definition previously introduced provides only one way to assess C2 quality. 
While it is easy to test for the presence of a properly designated commander, the DoD 
definition is not adequate in determining the quality of C2 exercised. This is because the DoD 
definition equates C2 quality to mission accomplishment [2]. The use of mission success alone 
as a measure of C2 effectiveness is problematic; while C2 may be necessary, it is not sufficient 
to guarantee mission success, which depends on many factors. As Ref. [2] states, the availability 
of appropriate means and the capabilities and behaviors of adversaries must be taken into 
account as well. Ref. [2] also goes on to state that C2 quality "should be directly measured by 
examining how well the functions of C2 have been performed." 

Warfighters have been able to articulate and define desirable C2 attributes [3], but have fallen 
short in proposing clear methods to translate these attributes into metrics. For example. Ref. 
[4] outlines a list of 12 C2 attributes from a Joint Capability perspective: 

1. Interoperability 

2. Understanding 

3. Timeliness 

4. Accessibility 

5. Simplicity 

6. Completeness 

7. Agility 

8. Accuracy 

9. Relevance 

10. Robustness 

11. Operational Trust 

12. Security 

Many of these C2 attributes are emergent properties of the C2 system as a whole, and can only 
be evaluated by taking into account both the systems involved and the C2 approach used, i.e. 
by evaluating the C2 architecture. Therefore, the need arises to develop a framework in which 
changes in factors that affect each of these 12 attributes can be measured to determine the 
impact on C2. This will provide a positive step in the direction of translating these attributes 
into actual metrics that can be used to evaluate C2 effectiveness. 


2 



The challenge of sufficiently measuring C2 effectiveness not only affects current operations, but 
has an impact on the composition and operations of future forces as well. Without an adequate 
measure of C2 effectiveness, it becomes exceedingly difficult to fully justify that the acquisition 
of future C2 systems or that investments in upgrades to existing systems will provide the most 
cost-effective benefit for the warfighter [5]. It also makes it difficult to determine what the best 
combination of materiel, training, and doctrine should be to achieve desired military objectives. 
Ref. [5] also makes note that the problem of analyzing warfare in the modern age is due to "an 
inability to quantify battlespace awareness, its mapping, or the capabilities to gather 
awareness." 

Thus, the goal of this research is to develop a method of characterizing C2 performance and 
effectiveness that is independent of mission success. The proposed method is developed using 
a Systems Engineering approach, which allows for the application of system architecting 
principles. Within this context, the architecture provides a means of defining the manner in 
which the contributing, constituent systems work together. The architecture itself can be 
further described as a shared, persistent technical framework that governs the structure of 
components within the overall system, their relationships and dependencies, and the principles 
and guidelines governing their design evolution over time. The architecture includes not only 
systems and their functions, but data flow and communications protocols, key system 
functions, as well as end-to-end functionality. The architecture is used to address possible 
changes in functionality, performance, or interfaces [6, 7, 8]. For this particular application to 
C2, the C2 architecture is then viewed as a combination of C2 systems and a C2 approach. The 
C2 approach, as discussed in Ref. [2] defines the allocation of decision rights, patterns of 
interactions among the actors and the distribution of information and awareness in and 
between competing forces [2]. 

This research investigates a time-valued information entropy-based method used to quantify 
the amount of awareness possessed by both friendly and enemy units of their surroundings 
during the course of a simulation. It will be shown that this time-valued measure of awareness 
serves as a suitable measure of C2 performance during the simulation. The goal of this research 
then is to determine how this existing information entropy-based method can be extended to 
aid C2 decision makers in understanding and evaluating military C2 effectiveness independent 
of mission success, particularly for complex military System-of-Systems network architectures. 
The end result is a set of analyses that can be incorporated into traditional Modeling & 
Simulation techniques to evaluate and classify C2 system performance under varying factors 
and conditions. These changes can include differences in the following: C2 systems and 
approaches, enemy action, information sharing and decision making, planning, intelligence 
collection and data gathering, platform and sensor performance, etc. From this, a more 
quantitative estimate of desired C2 attributes such as agility, robustness, and responsiveness 
can be achieved. Collectively, this previously unpublished set of analyses is referred to as TABS 
or Tracking Awareness in the Battlespace during Simulation. 

Addressing the problem in this manner allows for the later creation of a suitable modeling and 
simulation (M&S) environment upon which a virtual experimentation framework for evaluating 
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C2 effectiveness can be developed. TABS will prove to be a key requirement and enabler for 
developing such a future framework. 

Uncertainty & Time in the Battlespace 

Ref. [9] provides a useful perspective on C2 that states "Command and control is inherently an 
iterative decision making process, as feedback from the battlespace is incorporated into plans 
and corrective actions." Consequently, we must be able to come to understand the context in 
which certain decisions and actions are taking place, if we are to understand the overall 
effectiveness of different C2 architectures or the impact of different factors such as technology, 
interoperability, operational trust, etc. Perhaps the two most important factors that affect any 
decision making process are uncertainty and time, and these prove to be the two fundamental 
factors that define the C2 environment in every military operation [10]. 

Uncertainty has many different definitions and connotations. In this case, uncertainty can be 
defined as the difference between what is actually known and what is desired to be known 
about any given situation [10]. Further complicating the matter is that information and derived 
knowledge obtained from the battlespace is both limited and perishable. The enemy is usually 
constantly taking new actions to change the current situation, the rapid tempo of modern 
operations limits the amount of information that can be gathered and processed before having 
to make another decision, and if taken to the extreme the pursuit of additional information can 
lead to operational paralysis. Thus, as Ref. [10] states, "The key to achieving command and 
control will always come down to finding a way to cope with the effects of uncertainty and 
time." 

Coping with these effects means achieving and maintaining an acute awareness of the 
battlespace and current situation in order to gain knowledge and understanding of the 
operational area's environment, factors, and conditions. Thus, Battlespace Awareness (BA) is 
defined as "The ability to understand dispositions and intentions as well as the characteristics 
and conditions of the operational environment that bear on national and military decision 
making by leveraging all sources of information to include Intelligence, Surveillance, 
Reconnaissance, Meteorological, and Oceanographic" [4]. This includes knowing the status of 
friendly and adversary forces, as well as neutrals and noncombatants in addition to the weather 
and terrain. Figure 1 provides an example decomposition of the relevant battlespace objects 
and features that forces would need to be aware of during an operation. 
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Battlespace 



Figure 1: Example Battlespace Decomposition 


High levels of awareness lead to comprehensive and accurate assessments, aids in successfully 
applying combat power, and helps protect the force and/or complete the mission [1]. In this 
way, establishing and maintaining BA is crucial to mission success and is a defining trait of an 
effective C2 architecture. A related term is Situation Awareness (SA), which can be described as 
being able to perceive and comprehend the current status of one's environment, and then 
project what the future state of the environment might look like [11]. While this term proves 
useful as well, SA usually implies some human-in-the loop testing. This research seeks to 
address C2 M&S during the conceptual design phase, typically characterized by limited system 
information but where architectural tradeoffs have the most impact on cost, schedule, and 
performance [12, 13]. Also, to reduce the complexity of the effort, there is a desire to avoid 
complex cognitive models of human understanding and reasoning, especially when applied 
under battlefield conditions. For these reasons, the term BA will be utilized more often. 


Measuring Uncertainty 

The aim of C2 then, is to deal with the uncertainties inherent in warfare during the course of an 
engagement in a manner that promotes mission success. Since awareness, whether described 
as BA or SA, is a crucial aspect of effective C2 it follows that measuring awareness in terms of 
uncertainty and time may help in better understanding and evaluating C2 architectures. A 
literature search uncovered previous efforts that described and developed methodologies [5, 
14) for quantifying BA in such terms by applying the techniques developed in the field of 
Information Theory [15]. Specifically, Shannon's Information Entropy is applied to quantify 
awareness to capture not just what is known about the battlespace, but also precisely how well 
it is known [5]. 

Entropy is a fundamental property that can be described as a measure of a system's disorder or 
unpredictability. Shannon applied the concept of Entropy to the uncertainty associated with a 
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random variable, making it possible to quantify the expected value of the information 
contained in a message [15]. The greater the amount of measured entropy, the greater the 
uncertainty; this means there is a small amount of informational value contained with the 
message or signal. 

Ref. [15] provides an example using the simple toss of a coin as the basis of the signal passed 
over the communication channel. Only two outcomes are expected and can be passed along as 
information from the source to the receiver, either heads or tails. Therefore, the measured 
entropy H(X) represents the expected surprise that results from the coin flip. Mathematically, 
this can be expressed using the following equation: 


H{X) = -Y,pi.x.)\og^ p{x.y,{x^:i = \,...,n] (i) 

1=1 

Continuous distributions can also be used, resulting in a differential form of Equation 1. Since 
there are only two possible outcomes n = 2. If a logarithmic base of b = 2 is chosen, then the 
value of H(X) is expressed in bits. Thus, a message containing the results of the coin toss only 
requires at most 1 bit to encode the message, where X = 1 represents a result of heads and X = 
0 represents a result of tails, for example. The following graph can be created using Equation 1. 



Figure 2: Coin Toss Entropy Plot 

Because of the discrete nature of the variables involved, X| = 1/n gives the maximum entropy for 
a discrete distribution of n outcomes. Consequently, the maximum entropy of 1 bit occurs at x = 
Vi. This corresponds to the maximum uncertainty of the result of the coin toss. If for example, 
the coin is altered so that it always comes up heads or tails, the amount of uncertainty and thus 
entropy is zero. Intermediate values of H(x) can be interpreted as an unfair coin that is 
artificially biased towards either heads or tails. 
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Applying Information Entropy to the Battlespace 

Ref. [5] identifies and develops a methodology for applying Shannon's Information Entropy to 
mathematically quantify awareness in a military C2 environment. This is then used to create an 
awareness curve that shows the awareness of the C2 system throughout the process of 
attacking a ground target from the air. This awareness curve is a plot of entropy vs. time. The 
higher the entropy value calculated at a given point in time, the lower the awareness and vice 
versa. The information warfare entropy model presented in Ref. [5] serves as a basis for 
constructing a C2 signature curve that will aid in determining the effectiveness of various C2 
architectures. First, a formal process must be described that extends the model presented in 
Ref. [5] for use with many dispersed, collaborating systems interacting within a battlespace that 
contains many relevant features that impact uncertainty. This process is described as the 
following: 

1. Discretize the battle space into relevant objects/features such as the location, ID and 
type of friendly/enemy forces, environmental and hazardous features, and resources 
such as data & information. These can be referred to as state properties of the battle 
space. See Figures 1 and 3. 

2. Model each state property as a discrete probability distribution. Probability estimations 
can then be derived from the performance of system functions (sensing, assessing, etc.) 
corresponding to related mission tasks. See Table 2. 

3. Use Information Entropy to determine the amount of maximum uncertainty, U, based 
on the maximum number of possible outcomes. See Equation (2). 

4. Use Information Entropy to determine the amount of uncertainty, H(x), represented by 
the probability distribution. See Equation (3). 

5. Transform Fl(x) to a measure of awareness, A. See Equation (4). This way, total 
awareness of the battle space for a particular agent means having complete certainty of 
the state property for each battle space object/feature within the battle space. 

6. Incorporate the BA calculations into a warfare simulation. 

7. Analyze the resulting C2 signature plot of Awareness versus time to determine the 
effectiveness of various C2 architectures. 



Location 
Threat ID 
Type 

Op erational Level 


-5f(0= Type 


Location 


Hazard Level 


(0 = Receiver 
Type 


Sender 


Figure 3: Example Actor, Environmental Hazard, and Resource State Properties 
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Table 1: Example Non-Location State Property Values 


State Property 

Example Values 

Actor Threat ID 

Red, Blue, Neutral/Noncombatant 

Actor Type 

Aircraft, Tank, Facilities/Infrastructure 

Actor Operational Level 

Fully Operational, Disabled, Destroyed/Neutralized 

Hazard Type 

Terrain, Weather, Nuclear/Biological/Chemical 

Hazard Level 

Low, Medium, High 

Resource Sender 

Specific Actor within the Battlespace 

Resource Receiver 

Specific Actor within the Battlespace 

Resource Type 

Data Link, Jet Fuel, Senior Watch Personnel, etc. 


Table 1 provides an example of the values that can be assigned to the non-location based state 
properties. Meanwhile, Table 2 provides an example awareness measurement for the Threat ID 
state property of an un-identified unit, where three cases are shown. The first is where there is 
max uncertainty, as the unidentified unit is estimated to be an enemy (Red), friendly (Blue), or 
Neutral unit with equal probability. The opposite extreme (Case 3) is where the unit is quickly 
and easily identified, leading to an awareness value of 1. Case 2 demonstrates a calculation 
where the uncertainty distribution is skewed between Cases 1 & 3, resulting in an intermediate 
value. The corresponding equations are as follows: 


Table 2: Entropy calculations for quantifying Threat ID awareness 



Threat ID Probability Distribution 

Awareness Calculations 

Red Unit 

xl 

Blue Unit 

x2 

Neutral 

x3 

U (bits) 
log base = 2 

H(X) (bits) 
log base = 2 

A(t) 

Case 1 

(Max Uncertainty) 

1/3 

1/3 

1/3 

1.585 

1.585 

0 

Case 2 

(Intermediate) 

1/4 

3/4 

0 

1.585 

0.8113 

0.4881 

Case 3 

(Max Certainty) 

1 

0 

0 

1.585 

0 

1 


U = H{X)^^=\ogM 


= maximum number of possible outcomes 
n = number of non - zeropossibleoutcomes 


( 2 ) 


i=l 


(3) 


O.A(0 = l-^.l 

U (4) 

Quantifying the uncertainty due to location within the battlespace requires also taking into 
account both the area and resolution of sensing capabilities as well the speed and direction of 
objects as they move within the battlespace. Different sensors have different resolutions to 
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which they can accurately pinpoint a target, and this effect must be taken into account in the 
entropy calculations [5]. This can be seen in Equation (5), where Equation (3) has been modified 
to incorporate the effects of different sensor resolutions. 


H{X) = 


n 

^p(x,.)log^ p{x.) 

^=1 


+ log^(A^);{x,. :/ = l,...,n} 


(5) 


In order to use Equation (5), the battlespace is divided up into smaller areas or grids, where the 
minimum size of a grid cannot have a value of less than 1 in order to avoid problems with 
negative logarithmic values. For example, an area of operations that measures 3,600 km^ 
(slightly less than the area of the state of Rhode Island) can be subdivided into 100 cells, each 
measuring 6km by 6km. In this case, 1 m^ is selected as the smallest resolution. The maximum 
entropy, U, for the area of operations can then be determined using the following equations: 


U=H{X)^ =log,(nJ + log,(A,„,J 


( 6 ) 


U = H(X)^ =log2(100) + log2(3,600£6m") = 38.39 (7) 


The probability of locating an object within a cell can be assigned to individual cells. Based on 
those probabilities and the given sensor resolution location-based awareness values can then 
be obtained. An example is given in Table 3 using the area of operations previously described: 


Table 3: Example Location-Based Awareness Calculations 


Quantifying Location Awareness 

U 

bits 

H(X) 

bits 

A(t) 

Case 1: Undetected in Wide Search Area (Ar = 180 km^); 

5 Cells each with location probability = 1/5 

38.39 

29.74 

0.23 

Case 2: Undetected in Narrower Search Area (Ar = 72 km^); 

2 Cells with location probabilities of 1/3 and 2/3 

38.39 

27.02 

0.30 

Case 3a: Positive Detection (Ar = 10 m^); 

1 Cell with location probability of 1 

38.39 

3.32 

0.91 

Case 3b: Positive Detection (Ar = 1 m^); 

1 Cell with location probability of 1 

38.39 

0 

1 


The first and second cases described in Table 3 are for undetected objects whose locations have 
been narrowed down to a certain number of cells or grids within the area of operations. For 
these cases, the resolution, Ar, is set equal to the total area of the number of cells. The third 
case describes a situation where the object has been detected within a single cell, and 
highlights the impact of sensor resolution. The sensor in case 3a has a much larger resolution 
than the sensor in 3b, resulting in a lower awareness value. 

The second effect that must be accounted for is the changing speed and location of objects in 
the battlespace. As an object's location changes, this increases the number of cells that must be 
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assigned a non-zero probability, resulting in increased entropy and decreased awareness. 
Accounting for this requires the use of a diffusion model that will accurately depict the growth 
of the area of uncertainty of an object's location if it is not constantly tracked over time. 

Creating Command & Control Signatures 

This process can be repeated for each state property so that a picture emerges of the level of 
awareness for each battlespace actor. This picture is not a static snapshot, but updates as the 
actors interact with one another and their environment. A matrix of awareness values for each 
force can be created that represents the awareness at a given time each actor possesses 
regarding each battlespace object or relevant feature. These awareness values can then be 
summed and normalized to values between zero and one to create an awareness value for the 
overall force. For example, if each member of the blue force has complete knowledge of every 
other object within the battlespace including other blue force actors, red force actors, hazards, 
and resources then the blue force as a whole would have a total awareness value equal to one. 
This allows for the plotting and analysis of not only an entire force, but individual units within 
each force as well, if desired. This has many important benefits. For example, one may analyze 
whether the level of evenness/unevenness of the distribution of awareness across units is an 
important factor under certain conditions. Also, this can help determine if the awareness level 
of a particular unit(s) seem to contribute more or less to overall mission success and the 
underlying cause for this. This can help identify weak links and key nodes within the C2 system 
architecture or help determine more efficient ways to distribute information among key actors. 

Similar to Ref. [5] where entropy was plotted against time, a C2 signature plot can be created 
that depicts awareness versus time. For example. Ref. [15] utilizes some of the analyses that 
comprise TABS to compare the effectiveness of different combinations of C2 decision and 
information sharing network architectures. In this problem formulation, a team of Blue search 
agents are tasked with conducting an effective search of enemy Red agents that are actively 
trying to evade detection. An example C2 signature plot created from this M&S environment, as 
well as the corresponding Blue search and Red evasion efficiencies are shown in Figure 4. 



Figure 4: Example C2 Signature Plot and Search/Evade Efficiencies for Blue vs. Red Forces 
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From Figure 4, it is clear to see that though the Blue Force begins the engagement with zero 
knowledge of the battlespace, the Blue Force is quickly able to establish and maintain 
information superiority. 

The C2 signature plot can be used to analyze C2 architecture performance during a combat 
simulation, and represents a way to evaluate C2 effectiveness independent of mission success; 
High awareness values may not always correlate to mission success due to other factors that 
may need to be addressed. Since the C2 signature plot is a visual means of expressing C2 
effectiveness, it can also be used to develop a classification scheme of different C2 architecture 
performance, as seen in Figure 5. 



The classification scheme takes into account the level of awareness achieved through planning, 
intelligence, and data gathering. Poor planning results in lower initial awareness values while 
superior preparation results in higher initial awareness values. C2 agility is defined by Alberts as 
the capability to successfully cope with changes in circumstances [3]. In terms of signature 
classification, this translates to being able to achieve and maintain high levels of awareness 
over the course of an operation. 

Thus, four distinct regions can be identified in Figure 5 that aid in classifying different behaviors 
of C2 architectures. Region I represents the ideal case where perfect awareness exists 
throughout. Region II can be classified as "Fr/agile", a term that indicates that though the C2 
system effectively ramped up to achieve a high level of awareness during the engagement, 
there was poor initial planning. This could lead to unfavorable outcomes under different 
circumstances [17]. Region III is characterized by both poor planning and poor C2 performance, 
so that low values of awareness occur throughout the engagement. Finally, Region IV is 
indicative of a rigid C2 architecture that cannot maintain high values of awareness as the 


11 




















engagement continues on. It should be noted that it is possible for multiple classifications to be 
present over the course of highly complex engagements. 

The creation and classification of C2 signatures yields many important benefits. C2 signature 
analysis, combined with a rigorous experimentation plan can help identify and address key 
factors that have the most impact on C2 effectiveness and overall mission success. This can 
then be linked to specific C2 systems or approaches that need to be changed to deliver the 
most effective results. Or the impact of certain battlespace conditions can be isolated that have 
the most impact on C2 performance. An analyst can also explore if there is an average 
awareness threshold that must be maintained and under what circumstances this must occur. 
This could help in achieving C2 system agility and robustness. Likewise, an analyst can 
determine which key factors to exploit to minimize the awareness of an opposing force. 


Actual vs. Perceived Awareness 

Using entropy as a basis to measure BA and thus C2 effectiveness provides a flexible framework 
that is able to capture many non-linear effects present in real warfare that serve to introduce 
further uncertainty. Measuring entropy gives a sense of "expected surprise" since the 
measurement of entropy is based on one's own beliefs that are then translated into a 
probability distribution. Actual battlespace conditions may vary significantly, however. As a first 
example, the effects of misleading, false, or incorrectly processed data and information can be 
introduced into the M&S and captured in the entropy calculations. Figure 6 is comprised of two 
different examples that can illustrate how it becomes possible to measure unexpected surprise, 
or A. Each blue grid of 9 cells represents a state space. In this example the state space is a 
location state space that defines the probability distribution of where a Blue Force actor 
believes a Red Force actor to be located. 


Blue Force belief: 


0 

0 

1 

3 



1 

0 

0 

3 



1 

0 

0 

3 


Actual: 


0 

0 

0 

0 

0 

0 

1 

0 

0 


A for Event in SW Cell: 


A = l-0 = 1 


II) 

Blue Force belief: 


1 

9 

1 

9 

1 

9 

1 

1 

1 

9 

9 

9 

1 

1 

1 

9 

9 

9 


Actual: 


0 

0 

0 

0 

0 

0 

1 

0 

0 


Greater overall uncertainty, 
but less unexpected surprise 

A = l—!- = - = 0.89 
9 9 


Figure 6: Calculating Unexpected Surprise 
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In Case I, the Blue Force actor believes the Red Force actor is somewhere in the eastern most 


part of the grid when in fact the Red Force actor is located in the southwest corner cell. At this 
point in time, if the Blue Force actor were to encounter the Red Force actor in the southwest 
corner, the amount of unexpected surprise. A, can be measured as the difference in 
probabilities assigned to the southwest cell in each grid for Case I. This yields a maximum A of 1. 
For Case II, the Blue Force actor is completely uncertain as to where the Red Force actor is 
located. Thus, a lower A value of 0.89 is calculated. Figure 7 shows how this concept can be 
extended to a visual display termed a "Surprise Mapping." 
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Figure 7: Surprise Mapping 


Modeling Shared Awareness & Trust 

Information and thus awareness may be shared across the battlespace by participating actors. 
In reality, between two actors, this shared information may confirm or conflict with previously 
held beliefs. This effect may be captured using an entropy-based framework to measure 
awareness. Quantifying this aspect, however, may require the use of Bayesian-based methods 
to help combine probabilities. Also, since operational trust was identified as a desired C2 
attribute, this effect may be included in the modeling as well. 

Bayes' theorem provides a method to show how new information can be properly used to 
update or revise an existing set of probabilities. Revised probabilities are based on posterior 
probabilities, P(Ai), that are updated based on a conditional event B. Bayes' theorem is 
expressed in Equation (8) [18]. 


^P{A.)PiB\A.) 


( 8 ) 
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Figures 8 and 9 provide examples of how Bayes' theorem can be possibly applied to include the 
effects of shared awareness in the cases of confirming and conflicting information. 
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Figure 8: Shared Awareness for Confirming Information with Full Trust 
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Figure 9: Shared Awareness for Conflicting Information with Full Trust 

Figure 8 shows the impact of confirmatory information when updating the state space for an 
actor. This causes entropy to decrease and awareness to increase. Figure 9 shows that when 
the incoming information conflicts with the prior held belief, the opposite effect is encountered 
where the amount of entropy increases while awareness decreases. Both cases assume the 
incoming information is fully trusted. It should also be noted that this operation is non- 
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commutative. The prior held belief forms an important basis and impacts the final value of 
awareness. 

Trust can be incorporated into the Bayesian calculation through the inclusion of a trust 
percentage. The value of the trust percentage between actors sharing specific information can 
be based on numerous factors if desired, such as prior history and experience, reliability, or 
some estimate of the relevancy of the information due to its perceived timeliness, accuracy, or 
correctness. Once the trust percentage is determined, the impact on shared awareness can be 
modeled by altering the multiplier (M) used in the Bayesian calculations. An example of how 
this can be applied is shown in Figure 10. 



Figure 10: Incorporating Trust into Shared Awareness Calculations 


Now, the impact of trust can be seen on the Bayesian calculations for shared awareness, as 
seen in Figure 11. This is the case for confirming information with varying degrees of trust. 
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Figure 11: Shared Awareness for Confirming Information with Varying Trust 


15 























































Figure 11 shows that when the information is not trusted at all, the prior probabilities of the 
original state space is maintained. As trust in the incoming information grows, greater 
awareness values are calculated. Other aggregation rules are possible, though, that can capture 
additional effects. For example, a pessimistic and untrusting actor that only accepts the highest 
entropy/lowest awareness set of values can be modeled. Or, the effects of an overly optimistic 
and trusting actor who consistently substitutes his/her own beliefs for the highest awareness 
values regardless can be modeled as well. These represent either/or (min/max) types of 
aggregations. 


Network Centric Warfare Effects 

The modern, post Cold War military of today can be characterized as placing greater emphasis 
on the use of Information Technology (IT) and Network Centric Warfare (NCW) principles to 
realized battle space dominance [9,19]. As Ref. [9] states, "Network Centric Warfare is the best 
term developed to date to describe the way we will organize and fight in the Information Age." 
This is in contrast to platform-centric warfare, where each weapon or platform operates 
independently for the most part, and where a military must mass force in order to achieve 
combat effectiveness. On the other hand, during NCW effects are massed rather than force. 
This is accomplished through increased shared awareness and information superiority through 
collaboration. The potential drawbacks are the increased possibility for information overload 
and the increased complexity that arises due to the networking of individual platforms [20]. 

The network architecture helps determine the manner in which systems share and process 
information. Specification of the overall network architecture goes beyond simply defining 
which systems must collaborate, but also means specifying the degree of interoperability 
between systems, or the degree in which information or services are exchanged [1]. It is desired 
that information and services are exchanged in a timely, secure manner to ensure mission 
success. Using TABS, analyses can be conducted in which system and network parameters such 
as communications latency, bandwidth, information processing capability, network size, etc. 
can be varied and the impact on BA and mission success quantified. From these analyses, it can 
be determined where capability gaps exist and what combination of materiel, doctrine, tactics, 
procedures, etc. are the best to employ to fill those critical gaps. 

Thus, the selection of an appropriate M&S platform when constructing the warfare simulation, 
coupled with the entropy-based awareness framework should allow network and collaborative 
effects such as data fusion, limited bandwidth, information overload, etc. to also be modeled. 
This will allow analysts and decision makers to quantify the potential benefits of NCW versus a 
traditional platform-centric approach, while also helping to mitigate the possible drawbacks 
from increased network complexity. 

Incorporating TABS into Modeling & Simulation 

The next step towards investigating optimal C2 architectures is identifying an environment 
capable of modeling these architectures and simulating their effectiveness in various missions. 


16 


Over time, there have been many approaches to modeling and simulating warfare. Since 
warfare is extremely complex with interactions between numerous entities giving rise to often 
unpredictable and emergent behavior, agent-based modeling (ABM) approaches are often 
used. For example, ABM has been used to formulate and simulate mission plans [21], model 
terrorist networks [22] and land combat [23], and simulate fully autonomous hierarchical and 
adaptive control of tactical forces [24]. The appeal of any ABM approach is that it allows one to 
model and observe agent reactions to real-time battlespace information and conditions as they 
dynamically evolve. Discrete Event Simulation (DES) and System Dynamics are examples of 
other M&S methods that may be employed as well. Each has its benefits and limitations [25]. 

Regardless of the particular M&S method used, it is necessary to define a higher level process 
flow that will help facilitate the analyses enabled by TABS. These processes represent the 
actions actors within the battlespace must execute in order to gain awareness of the 
battlespace, the decisions and actions they execute during the simulation, and the feedback 
mechanisms that make C2 an iterative decision-making process. Figure 12 depicts the overall 
structure of the simulation and the sequential relationship of each process. 



Figure 12: Example Simulation Process Flow 

The Plan/Intel process is responsible for determining the initial awareness values for each actor 
within the battlespace. Feedback mechanisms can be included such that battlespace updates 
can be communicated to help update mission planning and feed that back to actors within the 
battlespace. The Sense process is where different sensor models are executed for 
corresponding actors to determine any changes in awareness. The Comms process handles the 
exchange of data and information in order to incorporate shared awareness. Network effects 
such as latency, bandwidth restrictions, and information overload can be modeled within this 
process as well. The Decide process is where actors make decisions based on their current 
battlespace awareness, to include what routes to take through the battlespace and what 
courses of action to take. Once a decision is made, the Move and Engage processes are 
responsible for executing those decisions and determining the changes that occur to objects 
within the battlespace. The process is then repeated until victory conditions and stopping 
criteria are met. These can be based on the number of units lost or a certain time limit being 
exceeded, as examples. 
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Conclusion 

For a complex military SoS, especially there exists a wide array of architectural parameters that 
can vary that affects both C2 effectiveness and/or mission success. It is crucial that this analysis 
is conducted independent of measures used for mission success so that the effects of changes 
in C2 systems and approaches, data fusion and information sharing, platform and sensor 
effectiveness, etc. can be accurately determined. Until now, warfighters have been able to 
articulate and define desirable C2 attributes such as agility and timeliness, but have fallen short 
in proposing clear methods to translate these attributes into metrics. TABS provides an 
important first step in developing the types of M&S environments that better quantify the C2 
attributes that are of greatest important to warfighters and decision makers. This is necessary 
in order to provide decision makers with the best information to architect and acquire robust, 
cost-effective systems to meet warfighter needs. 

This research investigates the use of a time-valued information entropy-based method to 
quantify BA for both friendly and enemy units and forces. Through this research, a new set of 
analyses, collectively known as TABS is developed. TABS, or Tracking Awareness in the 
Battlespace during Simulation, extends the current methods of information entropy based BA 
measures so that the C2 performance and effectiveness of complex C2 SoS network 
architectures can be analyzed. TABS begins with a method of discretely defining the 
battlespace. This allows the application of information entropy based calculations to determine 
the changes in BA for different entities within the battlespace. Once this is accomplished, 
analyses corresponding to determining the level of unexpected surprise each actor or set of 
actors are subject to can be conducted. Next, the effects of shared awareness and trust can be 
mathematically modeled during the course of a simulation. Lastly, relevant network analyses 
can be conducted to determine the effect of changing architecture network approaches. 

Overall, these analyses directly relate to measuring the real-world effects observed in complex 
SoS architectures with networked components. This research illustrates how existing measures 
can be extended towards a more comprehensive analysis of C2 performance and effectiveness. 
This includes looking at factors such as trustworthiness and surprise, interoperability, network 
bandwidth, and network latency. Such real world effects such as misinformation, incomplete or 
inaccurate information, enemy deception, or information that fails to be transmitted in a timely 
or secure manner can be scrutinized within the M&S environment. 

The suite of information-entropy based analyses that make up TABS is designed to be 
implemented into traditional M&S techniques. This helps to create an environment where C2 
system performance can be classified for varying factors and conditions. This classification is 
referred to as a C2 signature. A C2 signature is best explained as a graph depicting the level of 
battlespace awareness achieved and maintained overtime. The C2 signature also allows for the 
evaluation of relevant C2 metrics such as robustness, agility, and responsiveness to changing 
conditions over the course of an operation. Ultimately, the creation of a C2 signature for a 
particular C2 architecture will provide decision makers a way to visually interpret C2 
effectiveness and helps answer the question: "What does effective C2 look like?" 
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Previous work (May 2009) with Office of 
Naval Research & JFCOM/Joint Staff (J6) 

- Development began in May 2009 
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-> Visual Command & Control Capabilities 
Tradeoff Suite (VC3ATS) 

- Primary focus on creating the best mapping 
of systems to C2 functions: 



Joint Close Air Support 


• “The quality of C2 should be directly 
measured by examining how well the 
functions of C2 have been performed.” ^ 

• Essential C2 functions described in 
more specific mission & system terms 

• USJFCOM Joint Common System 
Function List (JCSFL) & Joint Mission 
Threads^ 
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- System-of-Systems (SoS)/System 
architecting approach 
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Background & Motivation 




Developed 3 separate categories of metrics: 

1. Functional Coverage: How well are critical C2 functions 
being performed? 

2. Functional Allocation: How many functions are 
performed by a given C2 system within the portfolio of 
systems? 

3. Performance: How “good” are the C2 systems at 
ensuring mission success? 

• Official DoD Definition provides only one way to 
measure performance: Quality = Mission Success^ ^ 

• A list of 12 Senior Warfighter Forum (SWarF) 
approved attributes help define a “good” C2 solution^ 

• Need exists to transform these attributes into usable 
metrics to aid decision makers 

• Attributes are properties of the portfolio of systems 
as a whole -> impacts M&S efforts 



• Interoperability 

• Understanding 


• Timeliness 

• Accessibility 

• Simplicity 

• Completeness 

• Agility 

• Accuracy 

• Relevance 

• Robustness 

• Operational Trust 

• Security 


The C2 portfolio is a complex system-of-systems architecture comprised of many networked 
systems that must collaborate to ensure mission success within a dynamic threat environment. 
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2. Alberts, David S. and Hayes, Richard E. 
Understanding Command and Control. CCRP, 2006. 

3. JCIDS Manual. 19 Jan 2012 
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Problem Formulation 


• Functions can be accomplished in many 
different ways 

- Differences in C2 approaches must be considered 
as part of SoS architecture 

• End goal is to ensure mission success 

• The use of mission success as a measure 
of the “goodness” of C2 is problematic^: 

- The very definition of the mission is a function of 
command 

- While C2 may be necessary, it is not sufficient to 
guarantee mission success, which depends on 
many factors 

- For example, the availability of appropriate means 
and the capabilities and behaviors of adversaries 
and others 

• Research Question: How do we 
incorporate these factors into the M&S 
environment to measure C2 performance 
independent of mission success? 
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Understanding C2: Uncertainty & Time 


• “Our efforts to establish effective command and control are shaped by two 
fundamental factors that define the environment of command and control in every 
military operation - uncertainty and time.” 

- Uncertainty: The difference between what we actually know and what we want to know 
about any situation 

- “What is reported about the battlefield or the airspace, and the actual fact of the case, 
may be two entirely different things.” - General Richard H. Ellis, U.S. Air Force (Ret.) 

• Information and derived knowledge is both limited and perishable 

- Enemy may take new actions to change the current situation 

- Rapid tempo of modern operations limits the amount of information that can be 
gathered and processed before having to make another decision 

- If taken to the extreme, the pursuit of more and more information can lead to 
operational paralysis 




1.Department of the Navy. Naval Doctrine Publication 6: Naval Command and Control. May 1_ 


7 









Battlespace Awareness 


Battlespace Awareness (BA)^: Knowledge and 
understanding of the operational area’s 
environment, factors, and conditions 

Includes the status of: 

- Friendly and adversary forces 

- Neutrals and noncombatants 

- Weather and terrain 

High levels of shared awareness can lead to: 

- Comprehensive and accurate assessments 

- Aids in successfully applying combat power 

- Helps protect the force and/or complete the 
mission 



Image from: http://www.opmexperts.com/nato_opm3.html 


Establishing and maintaining Battlespace Awareness is crucial to mission success. 
Measuring BA in terms of uncertainty and time may help in understanding and evaluating C2. 
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Research Objective 


• Conceptual design challenges: 

- Modeling BA in a useful way during conceptual 
design, with possibly limited system 
information for C2 system-of-systems 
architectures 

- Avoiding complex cognitive models of human 
understanding and reasoning, especially when 
applied under battlefield conditions 

• Research Objectives: 

- Investigate a time-valued information entropy- 
based method for quantifying battlespace 
awareness^ 

- Determine how this method can be extended 
to aid C2 decision makers in understanding 
and evaluating military C2 effectiveness 
independent of mission success 
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Technical Approach: 


• Tracking Awareness in the 
Battlespace during Simulation 

• An analytic approach applied to M&S 
for estimating C2 effectiveness and 
attributes 

- utilizes the mathematical theory and 
concepts of Information Entropy to 
model Battlespace Awareness 

• Provides a way to: 

- Measure the effectiveness of a 
particular C2 systems architecture and 
C2 approach 

- Compare & contrast changes in C2 
system architecture/C2 approach 
independent of mission success 

- Helps classify different C2 alternatives 
according to exhibited C2 
characteristics or “C2 Signatures” 



Agility/Responsiveness 


TABS 



C2 Signature Classification 
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Technical Approach: 


• Shannon’s Information Entropy: 

- Entropy is a measure of 
disorder/unpredictability 

- Shannon applied the concept of 
Entropy to the uncertainty associated 
with a random variable 

- Quantifies the expected value of the 
information contained in a message 

• Can be applied to discrete or 
continuous distributions 

- The Normal distribution maximizes the 
differential entropy for a given variance 

- X| = 1/n gives maximum entropy for a 
discrete distribution of n possible outcomes. 

Differential form of Information/Shannon Entropy: 

00 

H{x) = -1ln[/(T[:)]/* {x)dx 

—00 



1. Shannon, C. E. “A Mathematical Theory of Communication”. October 1948. 


nformation Entropy 


i=\ 



Pr(X = 1) 

Entropy H(X) (i.e. the expected surprisal) of a coin flip, 
measured in bits , graphed versus the fairness of the coin 
Pr(X=1), where X=1 represents a result of Heads and X = 0 
represents a result of Tails . 
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Technical Approach: Information Entropy 


Some amount of $ hidden 
in one of three locations 

n 

H{x) = -'YjP(X i )logfc p(Xi);{Xi :/ = !,. 

i=l 



Estimated likelihood money is located behind each specific door 


Case# 

Door 1 

Xi 

Door 2 

X2 

Door 3 

X 3 

Entropy 
H(X) in bits 

I 1/3 

1/3 

1/3 

1.585 

II 

1/10 

3/10 

6/10 

1.2955 

III 

0 

1/2 

1/2 

1 

IV 

0 

1 

0 

0 



The greater the 
Entropy, H(X), 
the greater the 
amount of 
uncertainty 
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Technical Approach: Quantifying 
Battiespace Awareness _ 



Battiespace 


+ 


Blue Force Units 


Red Force Units 


Neutrals & 
Noncombatants 


Environmental 

Hazard 


Terrain 


Facilities & 
Infrastructure 


-1 


Resource 


Weather 


Nuclear/ 

Biological/ 

Chemical 


Data & 
Information 


Physical 

Materials 


Skills & Labor 


Relevant 
Battiespace 
Objects & 
Features 


Sf(r) = 


Example Actor State Properties 
Location 
Threat ID 
Type 

Operational Level 
Example Environmental Hazard State Properties 
Location 


(Red, Blue, Neutral/Noncombatant) 

(Aircraft, Tank, Facilities/ Infrastructure) 

(Fully operational, disabled, 
destroyed/neutralized) 




Examples 


Type 

Hazard Level 


(Terrain, Weather, NBC) 
(Low, Medium, High) 


SfiO- 


Example Resource State Properties 
Sender 


Receiver 

Type 


} 


(Specific actors within the 
Battiespace) 


(Data Link: Payload Control, Jet Fuel, Senior 
Watch Personnel, etc.) 


• Each Battiespace Feature can be represented by a State Matrix, S|(t) ^ Discrete Probability Distribution 

• The State Matrix is composed of relevant variables critical to decision making within the context of military 

operations 


• “Total awareness” of the Battiespace means having complete certainty with respect to each State Matrix 
variable at a certain point in time 
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Technical Approach: Quantifying 
Battiespace Awareness 


H{X) = -2^p(x.)log^ p{x^y,{x^ : / = 

i=\ 


U = H{X)^=\ogM 


Quantifying Threat ID 
Awareness 

Red Unit 
xl 

Blue Unit 
x2 

Neutral 

x3 

u 

bits 

H{X) 

bits 

A(t) 

Case 1 

(Max Uncertainty) 

1/3 

1/3 

1/3 

1.585 

1.585 


Case 2 

(Intermediate) 

1/4 

3/4 

0 

1.585 

0.8113 

0.4881 

Case 3 

(Max Certainty) 

1 

0 

0 

1.585 

0 

1 



= maximum number of possible outcomes 
n = number of non - zero possibleoutcomes 


0<A(0 = 1 


H{X) 

U 



<1 
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Technical Approach: Quantifying 
Battiespace Awareness _ 


• Quantifying the uncertainty due to 
location within the battiespace 
requires also taking into account: 

- Area & Resolution 

- Speed & Direction 

• The battiespace can be divided up into 
smaller areas, selecting units of area 
small enough to describe all 
resolutions with values greater than 
one^ 

• The probability of locating an object 
within a cell can be assigned to 
individual cells 

• Over time, the target location may 
change, increasing the number of cells 
assigned a non-zero probability, 
resulting in increased entropy^ 
“Diffusion ModeP” 


1. Beene, Eric A., “Calculating a Value for 
Dominant Battiespace Awareness”. DTIC. 1998. 



H{X) = 


tl 

pi^i) 





{x. 



6 km 


U = H{X)^ =logj(«„) + log,(A-<«J 

U = =logj(100) + logj(3,600£:6m") = 38.39 



Figure 2-5: Probability that a moving target is located in a particular cell after 
(a) 0, (b) 10, and (c) 20 time steps. Probability is indicated along the vertical axis. 
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Technical Approach: Quantifying 
B att iespace Awareness 


1 ) 


2 ) 



1 

5 


1 

1 

1 

5 

5 

5 


1 



5 



CD 


3 ) 





1 

3 

2 

3 

1 

1 

K 


6 km 



H{X) = 




i=\ 


Quantifying Location 
Awareness 

u 

bits 

H(X) 

bits 

A(t) 

Case 1: Undetected in Wide 
Search Area (Ap. = 180 km^) 

38.39 

29.74 

0.23 

Case 2: Undetected in Narrower 
Search Area (Ap. = 72 km^) 

38.39 

27.02 

0.30 

Case 3a: Positive Detection 
(A, = 10 m2) 

38.39 

3.32 

0.91 

Case 3b: Positive Detection 
(Ar= 1 m2) 

38.39 

0 

1 




Aj. = Resolution (Units of Area) 
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Note: Cell shapes other than square are possible for defining a grid. 
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• Signature Analysis: 

- Awareness profile of each unit over time 

- Overall awareness profile of the system as a whole 

- Changes in C2 performance with changes in C2 approach or 
changes to included systems & system performance 

• Summary statistics can be used (mean, median, mode, 
standard deviation, etc.) 

- How even/uneven is the distribution of awareness across units? 

- Does the awareness of a particular unit(s) seem to contribute more 
(or less) to overall mission success and why? determining impact 
of “weak links”, drop in capability from removing key units, etc. 

- Is there an average awareness “threshold” that must be achieved 
for mission success? 

- Does the C2 signature change significantly under different 
circumstances robustness 







• other aspects of Network Centric Operations can be 
modeled and investigated as well 

- Size and Complexity of information sharing architecture 

• Network Latency 

• Connectivity 

• Bandwidth 

- Experiments can be conducted to determine impact on Battlespace 
Awareness and therefore C2 effectiveness 
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Technical Approach: Shared Awareness 


• Measuring entropy gives a sense of “Expected Surprise” 

• This measure of entropy is based on one’s own beiiefs that 
are then transiated into a probabiiity distribution 

• Actuai battiespace conditions may vary significantiy, ieading 
to “Unexpected Surprise” 

• This aiso provides the opportunity to incorporate and view 
the effects of deception & misconceptions within the 
modeiing & simuiation (M&S) environment 

• The impact of information sharing on BA shouid aiso be 
addressed 






Technical Approach: Unexpected 
Surprise 


Asl 


Blue Force believes the 
following probabilities depict 
the location of a Red Unit 
within the battlespace: 


However, the Red Unit 
managed to slip detection and 
is not located where Blue 
Force expects: 


0 

0 

1 

3 

0 

0 

1 

3 

0 

0 

1 

3 



0 

0 

0 

0 

0 

0 

1 

0 

0 


At this point in time, if Blue Forces were to encounter the Red Unit in the Southwest corner 
of the battlespace, the amount of unexpected surprise. A. can be measured as the difference 
in probabilities assigned to that cell . , 
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Technical Approach: Unexpected 
Surorise 


Blue Force belief: 


Actual: 
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0 

0 

1 

3 


0 

0 

0 

0 

0 

1 

3 

Vs. 

0 

0 

0 

0 

0 

1 

3 


1 

0 

0 

Blue Force belief: 



Actual 


1 

9 

1 

9 

1 

9 


0 

0 

0 

1 

9 

1 

9 

1 

9 

Vs. 

0 

0 

0 

1 

9 

1 

9 

1 

9 


1 

0 

0 


A for Event in SW Cell: 


A = l-0 = 1 


Greateroverall uncertainty, 
but less unexpected surprise 

A = l-- = - = 0.89 
9 9 
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Technical Approach: Unexpected 
Surorise 





Each point 
represents 
an Event(E) 
occurring 
within the 
battlespace 




OJO 


on 

CD 

c 

CD 

fU 
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Errors due to: 

- Misperception 
- Miscommunication 
- Deception 


Surprise Mapping 


Desired 

El 

E3 • 

9 

^ E5 

Due to * 
Significant 

False Beliefs 

E4 

« 

Mix of 
Certainty/ 
Uncertainty 

E2 

• 

Due to High 
Uncertainty 


Low 


High 
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Technical Approach: 


• Shared information may confirm or 
conflict with previously held beliefs 

- Quantifying this aspect may require the 
use of approaches such as Bayesian 
methods or Kalman filtering 

- Trust may also be an issue and may 
need to be incorporated into the model 
as well 

• Bayes’ theorem provides a method to 
show how new information can be 
properly used to update or revise an 
existing set of probabilities 

• Revised probabilities are based on 
posterior probabilities, P(A|), that are 
updated based on a conditional event B 
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ncorporating Trust 



0.1 

0.1 

0.1 


8 

0.1 

0.1 

0.1 


J 

0.1 

0.1 

0.1 


7 -^ 

0.1 

0.1 

0.1 


0.6 

0.1 

0.1 

0.2 


0.6 

0.1 

0.1 

0.2 


0.6 

0.1 

0.1 

0.2 


0.6 

0.1 

0.1 

0.2 


00 

0.03 

0.03 

0.07 


0.76 

0.075 

0.075 

0.09 


7 -^ 

^ 72 ; 

0.089 

0.089 

0.095 


7 -^ 

^0.7^ 

0.1 

0.1 

0.1 


100% Trust 


50% Trust 


25% Trust 


0% Trust 


Modeling confirming information with varying levels of trust. 


P(A, I B) = 


P(A)f(gi4) 

f^P(A^}P{B\Aj) 

7=1 
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Summary 


• TABS provides a set of analyses for answering the question: 
“What does good C2 look like?” 

• Utilizes and extends a time-valued information entropy- 
based method for quantifying battlespace awareness 

• Goal is to aid decision makers in acquiring the best portfolio 
of C2 systems to ensure mission effectiveness 

• Provides a means of evaluating C2 effectiveness 
independent of mission success 
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